R 



C 



PORT 



RESUME 



S 



ED 018 200 

TEST BUS--VALIDITY OF THE SCHOLASTIC APTITUDE TEST FOR NEGRO 
AND WHITE STUDENTS IN INTEGRATED COLLEGES. 

BY- CLEARY, T. ANNE 

EDUCATIONAL TESTING SERVICE, PRINCETON, N.J. 

REPORT NUMBER ETS-RB-66-31 -JUNE-1966 PUB DATE JUN 66 



REPORT NUMBER ETS-RDR-65-6-18 

EDRS PRICE MF-$0.25 HC-11.12 26P . 



DESCRIPTORS- ^JUNIOR COLLEGES, ^EDUCATIONAL TESTING, 
PREDICTIVE ABILITY (TESTING), ^APTITUDE TESTS, 4=CULTURE FREE 
TESTS, *TEST VALIDITY, HIGHER EDUCATION, TESTING, GROUP 
TESTS, PROGNOSTIC TESTS, COMPARATIVE TESTING, SCHOLASTIC 
APTITUDE TEST, COLLEGE ENTRANCE EXAMINATION BOARD, 

FOR THIS RESEARCH, A TEST WAS SAID TO BE BIASED FOR 
MEMBERS OF A SUBGROUP OF THE POPULATION IF, IN THE PREDICTION 
OF A CRITERION FOR WHICH THE TEST WAS DESIGNED, CONSISTENT 
NONZERO ERRORS OF PREDICTION ARE MADE FOR MEMBERS OF THE 
SUBGROUP. SAMPLES OF NEGRO AND WHITE STUDENTS FROM THREE 
INTEGRATED COLLEGES WERE STUDIED. IN THE TWO EASTERN 
COLLEGES, NO SIGNIFICANT DIFFERENCES IN THE REGRESSION LINES 
WERE FOUND. IN ONE COLLEGE IN THE SOUTHWEST, SIGNIFICANT 
DIFFERENCES WERE FOUND, BUT IT WAS THE NEGRO SCORES THAT WERE 
OVERPREDICTED . THUS, IN ONE OF THE THREE SCHOOLS, THE 
SCHOLASTIC APTITUDE TEST WAS FOUND TO BE SLIGHTLY BIASED, BUT 
IN FAVOR OF THE NEGRO STUDENT. AS THE SCHOOLS USED IN THIS 
STUDY DO NOT REPRESENT THE FULL SPECTRUM OF COLLEGES IN THE 
UNITED STATES, NO GENERAL CONCLUSIONS CAN BE REACHED. 
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Test Bias: Validity of the Scholastic Aptitude Test for 

Negro and White Students in Integrated Colleges 

Abstract 

For this research, a test was said to he biased for members of a subgroup 
of the population ii, in the prediction of a criterion for which the test was 
designed, consistent nonzero errors of prediction are made for members of the 
subgroup. Samples of Negro and white students from three integrated colleges 
were studied. In the two eastern colleges, no significant differences in the 
regression lines were found. In the one college in the southwest, significant 
differences were found, but it was the Negro scores which were overpredicted . 
Thus, in one of the three scaools, the Scholastic Aptitude Test was round to 
be slightly biased, but biased in favor of the Negro student. 




Test Bias: Validity of the Scholastic Aptitude Test for 

Negro and White Students in Integrated Colleges 

T- Anne Cleary^ 

In a recent paper, Cleary and Hilton (19^6 ) discussed one possible 
interpretation of test bias. According to that definition, an item of a test 
is considered to be biased for members of a particular group if the item 
produces an uncommon discrepancy between the perfonnance of that group and 
the performance of other groups. That is, the members of the group obtain 
an average score which differs from the average score of other groups by 
more or less than expected from performance on other items of the same test. 

In terms of the analysis of variance, bias was defined as an item-group 
interaction. On the basis of their data, Cleary and Hilton concluded that 
the items in the Preliminary Scholastic Aptitude Test are not biased, and 
that, if the PSAT is discriminatory, the discrimination is not largely 
attributable to particular sets of items, but to the test as a whole. 

Another definition of bias is possible. The definition of bias used in 
the present study is concerned with the test as a whole used as a predictor: 

A test is biased for members of a subgroup of the population if, in the 
prediction of a criterion for which the test was designed, consistent nonzero 
errors of prediction are made for members of the subgroup. In other words, 
the test is biased if too high or too low a criterion score is consistently 
predicted for members of the subgroup when the common regression line is used. 
With this definition of bias, there may be a connotation of "unfair," 
particularly if the use of the test produces a prediction that is xoo low. The 
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present research was concerned with this second definition of Lias: The 

prediction of college grade averages from the Scholastic Aptitude Test (SAlO 
for Negro and white students in integrated colleges was studied. 

The validity of the SAT as a predictor of college grades for Negroes in 
Negro colleg'^'s appears to be at least as good as the typical validity for 
white students. Hills, Klock, and Lewis (1963) report correlations of SAT 
verbal and mathematics scores with first year average grades for freshmen 
entering both the Negro and white colleges in the Georgia State University 
System. The lowest correlations for both male and female students were found 
in the white colleges rather than in the Negro colleges. The validity of the 
test in Negro colleges is made more striking by the fact that the standard 
deviation of the scores in the Negro colleges was approximately half that in 
the white colleges. 

Data reported by Hills (1964) for the four academic years 1959 through 
1962 in the Georgia State University System were subjected to analyses of 
variance by Biaggio and Stanley (1964). They found that, when a correction 
for restriction in range was applied, the correlations of test scores with 
freshman grades were significantly higher for the Negroes than for the non- 
Negroes. When the restriction in range was not considered, they found that 
the correlations were significantly higher for non-Negro females than for 
Negro females, but there were no significant differences among males. 

Stanley, Biaggio, and Porter (1966) extended the Biaggio-Stanley (1964) 
study to cover six years, 1959 to 1964. When correlations with grade -point 
average, corrected for restriction in range in the predominantly Negro colleges 
and tiansformed into Fisher's Z , were subjected to four analyses of variance 
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(SAT-V for men and women, SAT-M for men and women), they were found to he 
significantly higher in the Hegro colleges. When the original correlations 
were used in the analyses of variance, no significant differences between Negro 
and non-Negro males were found, hut the correlations for non-Negro females 
were significantly higher than for Negro females. Stanley, Biaggio, and 
Porter concluded that S.AT-type test scores are valid for the prediction of the 
college grades of Negroes con^eting with Negroes and taught primarily hy Negroes. 

McKelpin (1965) studied the prediction of freshman grades from SAT scores 
and high school average in the predominantly Negro liberal arts college. North 
Carolina College at Durham. He found validities that were as high as those 

commonly reported in the literature. 

Roberts (1962) found that, in a sample of 129 Fisk freshmen, SAT-V scores 
had a correlation of .63 with freshman grade-point average, and SAT-M scores, 
a correlation of .68. In 1964, Roberts reported the correlations for 1962 
freshmen in eight Negro colleges with sample sizes ranging from 40 to 203. 

The median correlations with freshman grade-point average were: 



SAT Verbal 
SAT Math 



Male 

.52 

.46 



Female Total 



.49 

.51 



.50 

.47 



hese correlations are similar to those observed in other populations. 

When SAT scores have been used in combination with high school rank, 
similar multiple correlations have been found in both Negro and white colleges 

(Olsen, 1957; Roberts, 1964). 



A question has been raised, however, about the validity of the SAT for 
predicting academic success of Negro students in integrated colleges. Clark 
and Plotkin (1963) studied a group of students who had applied for aid from 
the National Scholarship Service and Fund for Negro Students in order to enter 
interracial colleges in the years 1952 to 1956. Complete information was not 
available for the entire sample, and at times it is difficult to determine 
which subsample was used for a particular comparison. Nevertheless, Clark and 
Plotkin suggest that perhaps the SAT is not a valid predictor of academic 
success for Negroes in integrated colleges. They found that while the SAT did 
discriminate between those who completed college with a B+ or higher average 
and those who completed college with a C+ or lower average, it did not 
discriminate between those who completed college and those who did not graduate . 

A possible explanation for the lack of relationship between grades and SAT 
scores is severe restriction in range; those students for whom complete 
information was available were a highly selected group. Campbell ( 196 ^) has 
pointed out that the colleges attended by these students varied widely in 
degree of selectivity and that it is not unlikely that those of higher ability 
went to more selective colleges where their grades were perhaps lower than 
might be expected at a less selective school. Since the same weight was 
given to grades achieved regardless of college attended, the relationship 

between grades and ability would be attenuated, 

Clark and Plotkin ( 1963 , p. 2l) also state that the academic performance 
of the students they studied was far beyond the level that would be indicated 
by such predictive indices as College Board scores. Whatever the inadequacies 
of the Clark and Plotkin study, such a discrepancy deserves further investigation. 
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Furpose 

An important aspect of bias is that concernea with the predictive validity 
of the test* If the regression of the criterion on the test is the same foi 
different groups, the test cannot be said to be biased in terras of its 
predictive validity. If the intercepts of the regression lines are different, 
consistent nonzero errors of prediction will be maae within each group. The 
purpose of this research was to study the regression of college grades on the 
SAT for Negro and white students in integrated colleges. Because high school 
rank-in-class is generally used with the SAT for the prediction of grades, 
rank-in-class was included in the analysis when possible . To determine whether 
differences in the regressions for Negro and white students were due to 
differences in curriculum and therefore in the criterion, a sample of white 
students matched with the Negro students on curriculum was also studied. 

Sample 

Two major difficulties were encountered in the selection of a sampi for 
this research. In order to compare the regression lines for Negro and white 
students, it was necessary to find a sufficient number of Negro and white 
students in the same college. In initial inquiries at various integrated colleges, 
it was discovered that administrators and faculty tended to overestimate the 
number of Negro students on the campus. When an actual count was made at some ^ 
of these colleges, there were too few Negro students to make the analysis 
feasible. Considering the percentage of the population of the United States that 
is Negro, the scarcity of Negro students in the integrated colleges is disturbing. 

A second difficulty encountered was the identification of the Negro 
students. Most schools had no record of the race of their individual students. 
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Perhaps, this situation will change in the future as it is realized that records 
are necessary for any investigation of bias or, more generally, equal oppor- 
tunity. 

Three schools were used in the study. 

School 1 is an eastern, state -supported- institution with approximately 
5000 male students . The race of the students was identified by having two 
persons examine independently the standard identification pictures in the 
school files. Wherever there was disagreement, a third judge was used. If 
agreement could not be reached, the student was classified as white, 
corroboration was obtained from a list of Negro students provided by the HMCP: 
five students not on the MAACP list had been classified as Negro, and one 
student on the NAACP list had been classified as white. The five students 
not on the NAACP list were retained as Negroes after further examination of 
the identification pictures. The race code of the one student who was on the 
NAACP list but who had not been classified as Negro was changed to Negro. 

Three samples were selected from school 1: 

Group li All Negro students. 

Group 2: A sample of white students matched with the Negro 



students on curriculum and class, and 
Group 3: A random sample of the white students. 

School 2 is also an eastern state -subsidized school with approximately 
10,000 full-time students. The Negro students were again identified by two 
persons examining the school identification pictures. When the curriculum 
and class were tabulated for the Negro students, it was discovered that most 
of the Negro students (8!* out of l!*8) were freshmen in Liberal Arts. The 
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remaining Negro students were scattered throughout the other eight curricula 
and three classes. To make the analysis less complex, only two groups of 
students were used: 

Group 1: All Negro freshmen in Liberal Arts, and 

Group 2: A random sample of the white freshmen in Liberal Arts. 

School 3 is a state-supported institution in the southwest with approxi- 
mately 6000 students. Race was identified by the Admissions Office. Three 

groups were used: 

Group i: All Negro students. 

Group 2: A sample of white students matched with the Negro 

students on sex, class, and curriculum, and 
Group 3: A random sample of the white students. 



Variables 

The criterion in each school was grade-point average (GPA). In all cases 
the grade -point average was converted to a 1 to 4 scale in which 4 represents 
the high end of the scale or a grade of A. Unfortunately, the grade -point 
averages obtained from the different schools have slightly different origins. 

In school 1, where all four classes were used, the grade-point average 
used was the average obtained at the end of one year in the school. In most 
cases, the average was obtained at the end of the freshman year; in a few 
cases of transfer students, however, the average was based on more advanced 
courses. Only freshman Liberal Arts students were used in school 2, so all 
grade-point averages were from the end of the freshman year. All four clasoes 
of school 3 were used and the grade-point average was the latest cumulative 




average obtained by the student • 
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The primary predictors were the Scholastic Aptitude Test veibal (SAT-V) 
and mathematical (SAT-M) scores. In all cases these scores were obtained from 

the school records. 

For students in school 2 and school 3> i't possible to obtain high 
school rank-in-class (HSR) . In school 2, rank was recorded in quintiles, but 
these were converted so that the resulting scores were: 10, 30, 50, TO, and 

90, with 90 representing the first quintile and therefore the top of the 
class. In school 3> rank was recorded as a normalized score ranging from 25 
to 75, with 75 indicating the top of the class. In school 3> rank-in-class 
was available for only about 50^, so the analyses were repeated using high 
school grade average (HSA), which was recorded on a scale ranging from 1 to 1^+ 
with 1^ representing the equivalent of an A+. 



Method of Analysis 

Correlations were computed among the variables available for each group 
within each school. For the correlations, all students who had each pair of 
scores were used for the calculation of the correlations between those scores. 

To determine whether the regressions of grades on SAT scores and high 
school rank were different for the groups of students within each of the three 
schools, the regrescion tests of the analysis of covariance were used. The 
calculations were performed by a method due to Beaton (196^) • 

The model for the regression tests with two predictors is 



Y. =■- 
ig 






+ B,V. 

1 ig 



" ®2«i6 






g 



+ b, V 
Ig 



. + b.^ M. 

ig 2g ig 



where 

Y is the predicted criterion score for individual i in group g; 
ig 
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pt is the constant term common to all groups; 

is the component of the regression coefficient for the predictor, V, 
that is common to all groups; 

is the component of the regression coefficient for the predictor, 

M, that is common to all groups; 
u. is the constant term for group g; 

b and b are the regression coefficients that are applied only 
Ig 2g 

in group g. 

The method of analysis makes it possible to test two hypotheses : 

(1) Equality of Slopes: b^^ = b^g = 0. This hypothesis states that, 

within each group, the validities of the predictors are the same. If the 
hypothesis is true and the b's are removed from the model, then the only 
remaining factor unique to the individual groups is the constant, 

The results of the previous studies of Negro students in Negro colleges 
indicated that the slopes would be equal within groups. If this hypothesis 
is rejected, the second test cannot be performed. 

(2) Equality of Intercepts (given that the slopes are equal): M-g = 0 

all g). [J. is the constant term that is unique to group g. If all p, are not 

g 

zero, then consistent nonzero errors of prediction are being made within the 
groups and the test must be considered biased by the definition of this study. 

Results 

Tables 1, 2, and 3 give the intercorrelations within each of the groups in 
the three schools. In school 1, the correlations of SAT-V with GPA are almost 
identical in all three groups. SAT-M, however, has its lowest correlations in 



er|c 
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the Negro sample and its highest correlations in the random white sample. It 
would seem that curriculum differences are, at least in part, conxributing to 
the lower SAT-M correlations in the Negro group, as the SAT-M correlations in 
the matched white sample are also lower than those in the random white sample. 
The standard deviation of SAT-M is smaller in the Negro sample than in the other 
two groups, but this is not an adequate explanation of the reduced correlation 
because the standard deviation of SAT-V is also smaller in the Negro group. 



Insert Tables 1, 2, and 3 about here 



In school 2, none of the validities is very impressive* All of the 
correlations for the Negroes involving high school rank-in-class are essentially 
zero. High school rank-in-class was a gross measure, quintiles, but this would 
not account for the differences between the two groups. The near zero correla- 
tions among SAT-V, SAT-M, and HSR in the Negro group are perhaps caused by 
the selection procedure of the college. If a composite score is used for 
selection and the selection ratio is small for a particular group, reduced 
correlations among the elements of the composite will be observed in the 

selected group. 

In Table 3, the similarity of the correlations for all three groups is 
rather striking in view of the discrepancies among the variances and means. 

All the correlations with GPA are quite high. 

The results of the regression tests are presented in Tables U, 5, 6 , and 
7 . The first hypothesis, equality of slopes, is not rejected in any of the 
throe schools. The second hypothesis, equality of intercepts, is not rejected 
in school 1 or school 2 ^ but is in school 3^ 
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Insert Tables J abuui hci-c 

At the bottom of Tables U, 5, 6, and 7 are the equations of within-t/ru.ij. 
regression lines and the common regression line. ‘I'lie similarity of tlu- 
predictions from each of the equations can be seen by substituting eommun 
values of the predictors into each equation. In school 1, if a student has 
a score of 500 on both SAT-V and SAT-M^ his predicted grade-point averages 
from the different equations will be: Negro, 1.86; matched white, 1.87; 

random white, 1.95i common line, 1.91* 1^* the student has scores equal to 

the average scores given in Table 1 for Negroes, his predicted grade-point 
averages will be: Negro, 1.32; matched white, 1.89; random white, I.98, 

common line, 1.92. 

In school 2, if a student has SAT scores of 500 and rank-in-class of 50, 
his predicted grade -point averages will be: Negro, 1.92; white, 1.85; 

common line, 1.36. If the average scores for Negroes are used, the predicted 
srade-poinr averages are: Negro, l.bh, white, I.87; common line, 1.86. 

Clearlv, in either school, it makes little difference .which regression line 
is used with these predictor scores c The differences between the predicted 
scores are small and insignificant, cut in both schools the common equation 
predicts a higher score than the Negro equation when predictor scores are 
eaual to the average scores for the Negro students. 

In school 3, a significant difference in intercepts was found in both 
analvses. The differences are not striking, but the large sample size makes 
the test powerful. If the regression lines from Table 6 are used, a student 
with SAT scores of 530 and HSR of 50 will have predicted scores: Negro, 2.20 
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matched white, 2 *^ 8 ; random white, 2.27; common line, 2.26. If the student has 
the average scores of Negroes, his predicted scores will he: Negro, 1.96; 

matched white, 2.46; random white, 2.53; common line, 2.44. For both sets of 
predictor scores the grade -point average of the Negro students is overpredicted 
when the common regression line is used. If the regression lines in lable 7 
are used, a student with SAT scores of 500 and HSA of 10 will have predicted 
scores: Negro, 2.34; matched white, 2.68; random white, 2.59; common line, 

2.58. If the student has scores equal to the average scores of Negro students, 
his predicted scores will be: Negro, 1.82; matched white, 2.28; random white, 

2.3I; common line, 2.23. Again, for both sets of predictor scores, the Negro 
student’s grade-point average will be overpredicted when the common regression 
line is used. 

Conclusion s 

The schools used in this study do not represent the full spectrum of 
colleges in the United States, so general conclusions cannot be reached. In the 
three colleges studied, however, there was little evidence that the Scholastic 
Aptitude Test was biased as a predictor of college grades. In the two eastern 
schools, there were no significant differences in the regression lines for ^ 
Negro and white students. In the one college in the southwest, the 
regression lines for Negro and white students were significantly different: 
the Negro students' scores were slightly overpredicted by the use of the 
common regression line. Thus, where the Scholastic Aptitude Test was found 
to be biased, it was biased in favor of the Negro student. 
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Table 1 



School 1 

Means, Standard Deviations, and Intercorrelations 

Group 1 (Negro) 



di 

Intercorrelations 





Mean 


Standard 

Deviation 


SAT-V 


SAT-M 


GPA 


SAT-V 


U 95 


67 




.12 

(59) 


.47 

(59) 


SAT-M 


525 


74 


.12 

(59) 


- 


.01 

(59) 


GPA 


1.82 


.65 


M 

( 59 ) 


.01 

(59) 


- 






Group 2 (Matched White 


) 












Intercorrelations 






Mean 


Standard 

Deviation 


SAT-V 


SAT-M 


GPA 


SAT-V 


557 


83 


- 


.14 

(60) 


.45 

(60) 


SAT-M 


598 


79 


.14 

(60) 


- 


.25 

(60) 


GPA 


2.23 


.67 


.45 

(60) 


.25 

(60) 


- 



Group 3 (Random White) 



Intercorrelations^ 





Mean 


Standard 

Deviation 


SAT-V 


SAT-M 


GPA 


SAT-V 


542 


79 


- 


.47 

(118) 


M 

(118) 


SAT-M 


571 


83 


.47 

(118) 


- 


M 

(118) 


GPA 


2.18 


.58 


.45 

(118) 


.i^l 

(118) 


• 



^Sample size appears in parentheses below the correlation. 
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Table 2 
School 2 

Means, Standard Deviations, and Intercorrelations 

Group 1 (Negro) 



Qi 

Intercorrelations 





Mean 


Standard 

Deviation 


SAT-V 


SAT-M 


HSR 


GPA 


SAT-V 


486 


67 


- 


.09 

(83) 


-.13 

(67) 


.26 

(83) 


SAT-M 


468 


68 


.09 

(83) 


- 


-.15 

(67) 


.17 

(83) 


HSR 


60 


20 


-.13 

(67) 


-■15 

(67) 


- 


.02 

(67) 


GPA 


1.80 


.69 


.26 

(83) 


•17 

(83) 


.02 

(67) 


- 






Group 2 (White) 


















Intercorrelations 


a 




Mean 


Standard 

Deviation 


SAT-V 


SAT-M 


HSR 


GPA 


SAT-V 


502 


80 


- 


.37 

(365) 


.27 

(346) 


.38 

(365) 


SAT-M 


517 


85 


.37 

(365) 


- 


.22 

(346) 


.30 

(365) 


HSR 


57 


22 


-27 

(346) 


.22 

(3W) 


- 


^38 

(346) 


GPA 


1.94 


.83 


.38 

(365) 


.30 

(365) 


.38 

(31*6) 


- 



^Sample size appears in parentheses below the correlation. 
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Table 3 
School 3 

Means, Standard Deviations, and Intercorrelations 

Group 1 (Negro) 



Intercorrelations 





Mean 


Standard 

Deviation 


SAT-V 


SAT-M 


HSR 


HSA 


GPA 


SAT-V 


338 


71 


- 


.51 

(131) 


.56 

(52) 


.37 

(131) 


.47 

(125) 


SAT-M 


371 


66 


.51 

(131) 


- 


.63 

(52) 


.35 

(131) 


.47 

(125) 


HSR 


63 


7 


.56 

(52) 


.63 

(52) 


- 


.89 

(52) 


.61 

(48) 


HSA 


9.9 


1.8 


• 37 

(131) 


.35 

(131) 


.89 

(52) 


- 


.51 

(125) 


GPA 


l.8l 


.56 


(125) 


.1*7 

(125) 


.61 

(48) 


.51 

(125) 








Group 2 


(Matched White) 












1 




a 

Intercorrelations 






Mean 


Standard 

Deviation 


SAT-V 


SAT-M 


HSR 


HSA 


GPA 


SAT-V 


426 


96 


- 


.59 

(258) 


.48 

(144) 


.36 

(258) 


.53 

(242) 


SAT-M 


455 


101 


.59 

(258) 


- 


.44 

(144) 


.36 

(258) 


.41 

(242) 


HSR 


5^ 


9 


.48 

m) 


.44 

(144) 


- 


.92 

(144) 


.67 

(135) 


HSA 


8.7 


2.3 


.36 

(258) 


.36 . 
(258) 


.92 

(144) 


- 


,64 

(242) 


GPA 


2,28 


.68 


.53 

(242) 


• 4i 
(242) 


.67 

(135) 


.64 

(242) 





^’Sample size appears in parentheses below the correlation. 
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Table 3 (contd.) 

Group 3 (Riindom Vfiiite) 

3p 

Intercorrelations 





Mean 


Standard 

Deviation 


SAT-V 


SAT-M 


HSR 


HSA 


GPA 


SAT-V 




100 


- 


.62 

(2325) 


.48 

(1300) 


.^5 

(2325) 


.^T 

(2181) 


SAT-M 


kSl 


101 


.62 

(2325) 




.45 

(1300) 


.1^0 

(2325) 


.39 

(2181) 


HSR 


55 


9 


U8 

■ (1300) 


.'^5 

(1300) 


- 


.89 

(1300) 


.66 

(1236) 


HSA . 


9.0 


2.3 


.^5 

(2325) 


.40 

(2325) 


.89 

(1300) 


- 


.6k 

(2181) 


GPA 


2.38 


.70 


(2181) 


.39 

(2181) 


.66 

(1236) 


.6k 

(2181) 


- 



^Sample size appears in parentheses below the correlation. 
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Common Regression Line : 

Y = + .003h2V + .00126m 

Multiple correlation " . 52 
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School 3. Analysis of Covariance 

3 Groups, 3 Predictors: SAT-V (v), SAT-M (m), and High School Rank (R) 

The Model: 



22 





>^ft 


p 


-P 


^iH 


•H ^ 


fH 0) 


fH 01 


♦H bD 


CO *H bD 


U 


^ '9 b 


a a 


VD cd cd 




• ^ »H 


0 


0 




U ^ 


ft 0 


ft 0 



iH 

O 

o 

V 



o 

•H 

■p 

(S 

K 



00 



O 

•H 

OJ 

K 

[X 4 



(M 

ro 

• 

rH 

OJ 






U) 

•H 



U) 

00 



+ 



t)0 

U) 

OJ 



Xi 

+ 



<D* 

Si 

CD 

§ 



B 

o 

to 

(U (U 

(U (U 

u ^ 

& tH 

o 



O CO 

• « 

IPvVO 
VO ir\ 
00 irv 

r-\ OJ 



ON rovD tr 

rH H O 

I — 1 I — 1 I I 



<D 

CS 

01 

CD 

c: 

cs 

<D 

2 



6 

o 

OT fd 
(U (U 
(U (U 

b 0 fX 4 

<D 

P tH 

o 



UNCO 

• • 

if\ 00 
if\ Lr^ 
-d- Lr^ 
-d- CVJ 
ir\ 



0\if\(M cn 

c— I c— I iH 

-d- -d- -d- 

C— I C— I C— I 



•H 

> 

bO 

iH 



rO 

+ 



bO 



a 

+ 



K 



bO 

•H 



00 



pq 

+ 



W) 

CVJ 



m 

+ 



(i) 

•rl 



pq 

+ 

li 






•H 



(/} 

■P 

CO 

0) 

EH 



CO 

<D 

bO 0) 



00 



bO 

CVJ 



bO 

iH 



CO 

<D 

ft 

O 

iH 

CD 

Ch 

O 

>:> 

■P 

•H 

fH 

Oj 

s 

H 



Si 

CD 

O 

6 

3 

CD 



O 

•H 

p 

•H 

U 

a 

> 

ch 

o 

0) 

o 

o 

CD 



<J\ LT\ 
LTNGO 
-d- L^^ 
^ OQ 
00 o 

LTWO 

H 00 
00 



O if\ 

o\o\ 

I — I CO 
rH 

iH CT\ 
LT\ 

00 



CO 

•H 

CO 

a 0) 

•H rC 
bO -P 
•H O 



U 

o 



ft 

■§H 
O H 

A 5 



CO 

•H 

CO 

0) 

■P 

0 

1 






CO 

■p 

ft 

0) 

o 

0) 

-p 

H 

«H 

o 

>:> 

■P 

•H 

fH 



CO 

01 

Si 

CD 

«H 

O 

6 

3 

CD 



a 

o 

•H 

p 

cS 

•H 

cS 

> 

tH 



ON VO H ICN 
ir\ ON H 00 

-it -:± ON IfN 

-f t^<S‘ 5 Q 

00 H O O 
ir\ H VO 
H 00 00 

cn 





0 




cS 


0 




0 


rH 


U -P 


u 


3 




iH ^ 


■P 


cd 


0) 


0 


O’ 


0) 


Clj (U 


0) 


P> 


<d 0) 




H 


0 


p 


0 








0 G 


:3 


EH 


D ft 


H 


OJ 


3 

0 

CD 


EH D 


P 



a 

•H 

bD 

•H 

u 

o 

■p 

o 



CO 

•H 

CO 

0) 

■P 

O 



CO 

►H 

CO 



ft 0) 



-I 



3 ^ 



O 

U 

U 





K K 


ft 










00 00 


CVJ 










-t" It 


rH 










H 


-d- 










OJ -t- 


-d- 










0 0 

• • 


0 

« 










+ + 


+ 










2 2 


s 










VO VN 


ft 










VO cn 


00 










iH 0 


0 










0 0 


0 










0 0 


0 










• 4 


• 










+ 1 


+ 










> > 


> 










VO 


VO 










-it H 


-t" 










OJ OJ 


iH 










0 0 


0 










0 0 


0 










• • 


• 










+ + 


+ 




K 






ir\ OJ 


CJN 




S 






rH 


ir\ 




0 






CVJ 


00 




-d- 






• • 


• 




0 






rH 






• 






1 ! 


1 






















II !! 


II 
















2 






H CVJ 00 




VO 






<>H <>H < >H 




00 

0 


00 


• • 








0 


VO 


CO 


• • 






0 


• 


01 




• « 




• 




a 


01 








1 ! 


•H 


■p 


01 




4 




iH 


•iH 


■p 






G 






•iH 




> 


0 


fl 




ft 


• • 


00 


♦rH 


0 






01 


l >7 


■P 


•H 


*>• rrt 






rH 


Cd 


CO 


^ 01 


B 


•rj 


0 


rH 


CO 


0 rG 


0 


ft 


0 


01 


0 ) 


u 0 






• 


U 


u 


bD -P 








U 


bD 


01 cd 


cd 


0 


+ 


0 


0 ) 


S 2 


ft 


•iH 




0 


ft 






CO 


CJN 










CO 


rH 


01 


ft 


H CVJ 


00 


01 


CO 


rH 


3 






u 


• 


ft 


0 


ft ft 


ft 


bO 


i 


•iH 






:3 


01 




■P 


0 


0 0 


0 


ft 


M 

If 


rH 


1 


u u 


u 






ft 


a 


0 0 


0 


a 


C>H 


2 


•H 






0 












g 






■P 






s 






•H 






0 






: 3 : 






0 











3- 



>) 

■p 

•H ^ 
iH (U 
•H to 

S3 

o 

U tH 

0^ o 



t-- 

o 



< J 

■p 

•H 



txi 



•H 

•s 

o 

Cw 
CU O 






o 

o 

o 



o 

•H 

cd 

K 



Lf\ 

t^ 



O 

•H 

+J 

Cd 

K 



CVJ 



o 

Lf\ 



c^- 

(U 

rH 

cd 



(U 

o 

c 

cd 

•H 

Cd 

> 

o 

o 

Cm 

O 

CO 

•H 

CO 

>> 

rH 

Cd 

C 

< 



oo 



o 

o 

o 

CO 



(D 

(£1 

Cd 

u 

(D 

5 



O 

o 

a 

CO 

x: 

to 

•H 

PC 

<0 

c 

cd 

•s 



S 

I 

S 

00 



> 

I 

E-< 

< 

CO 



CO 

o 

4-> 

a 

•H 

0) 

on 



CO 

ft 

13 

o 

o 

on 



0) 

no 

O 

S 

(D 

x: 



U) 

•H 

cn 



+ 



tiD 

•H 

"UD 

OJ 



+ 






bO 



+ 



bD 



a. 

+ 



bD 

•H 



fQ 

+ 



bD 

•H 



+ 



bD 

•H 



> 

rH 

+ 

li 

< 



bO 

•H 



CO 

•P 

CO 

<D 

Eh 



(D 

a 

01 

CO 

c 

cd 

(D 

2 



S 

o 

CO rc5 
0) 0) 
0) <U 
U U 
bDpn 
0) 

Q ^ 
O 



O 

1 ! 



bD 

on 



II 



bD 

OJ 



II 



bD 



CO 

0) 

ft 

O 

iH 

CO 

Cm 

O 

P 

•H 

fH 

Cd 

& 

W 



CO 

0) 

u 

cd 

& 

CO 

Cm 

O 

S 

CO 



CO CVJVOVO 
^ ^ on 

LT\ LT\ LT\ 

CVJ CVJ CVJ 



c 

o 

•H 

p 

cd 

•H 

Cd 

> 

cp 

O 

0) 

o 

u 

7S 

O 

CO 



CVJ H ir\vo 
on CVJ onoo 
0\^ ^ 
0\^ VO CO 
on o CVJ o- 
o ^ on 
onvo vD 

LT\ 



c 

•H 

bD 

•H 

u 

o 

p 

o 

•s 



cd 

p 

o 

£h 



CO 

•H 

CO 

(D 

x: 

p 

o 



CO 

•H 

CO 



ft 0) 

x: p 

o 

iH ft 
rH 



c 

p 

0) 

no 

c 



o 

p 

0) 



p 

o 

p 

u 

w 





0) 










P 








CO OJ 


Cd 


O VO 






• • 


7^ 


• • 






ir\ \r\ 


O' 


0\(J\ 






rH 


CO 


CO rH 






^ \T\ 




CVJ 


< 


< 


^ CVJ 


q 


VO CVJ 










CVJ 


O 


G\ 




(D 


1 — 1 


rH 


ir\ 




2 




1 — 1 


1 — 1 



o 

11 



bD 



CO 

P 

ft 

0) 

o 

u 

OJ 

p 

c 

M 

Cm 

O 

P 

•H 

fH 

cd 

W 



OJ 



£ 

o 




2 


2 


2 


M 




OJ 


CVJ 


O 


(U (U 


CO OJ OJ 


CXD 


on 




(U (U 
H U 


-d' -d' 


1 — 1 


O 


o 


Lf\ Lf\ Lf\ 


o 


o 


o 


bD ft 


OJ OJ OJ 


o 


o 


o 


(U 




• 


« 


e 


p <<-l 

o 




+ 


+ 


+ 



CO 

0) 

P 

Cd 

CO 

Cm 

o 

S 

CO 



C 

O 

•H 

P 

Cd 

•H 

Cd 

> 

P 

o 

0) 

o 

u 

o 

CO 



CVJ <o\co H 
on (T\ c^ CVJ 
VO ^ <J\ 

CM>- CVJ^ 
on ir\ ir\ O 
O VO CVJ ^ 
onvo VO 
ir\ 



CO 

•rl 

CO 

c (U 

•H x: 
bD 

•H O 
5^ ft 

3 H 
O rH 

P ::5 
cd a 

iH P 
Cd 0) 
P T5 
O C 
Eh D 



CO 

•H 

CO 

0) 

P 

P 

0 

1 

o 

o 

(U ^ 
P5 5^ 
« W 



> 

o 

CO 

iH 

O 

O 



> > 
<3\ H 
iH 

CVJ rH 
O O 
O O 



CO 

0) 

C 

•H 

c 

o 

•rl 

CO 

CO 

0) 

p 

bD 

0) 

K 

ft 

0 
u 
O 

1 

c 

•H 

P 

P 

•H 

:3^ 



e 


• 


4 


< 


+ 


+ 


+ 


ir\ 


CVJ 


CVJ 


o 




o- 




H 


iH 


\r\ 

• 


iH 

• 


iH 


• 


1 


1 


+ 


+ 


11 


11 


11 


s 



H CVJ on 

< <>H <>H 



o 

p 

bD 

0) 



ft 

o 

u 

O 



r-- 

ir\ 

O 

O 

O 



VO 



0) 






+ 


11 


P 


0) 








•H 


p 




> 


q 


P 


•H 






o 




P 


• • 


t- 


•H 




:!5 


(D 


iH 


p 


T5 




C 


O 


cd 


0) 


s 


•H 


O 


iH 


P 


o 


h-i 


• 


0) 


O 


T5 






P 


P 


q 


c 


+ 


P 


Cd 


cd 


o 




o 


2 


K 


•H 


o\ 


o 






CO 


on 








CO 


iH 


0) 


CVJ 


on 


<U 


O 


iH 






U 


• 


ft 


ft 


ft 


bD 


1 


•H 


7i 


q 


0) 




P 


O 


o 


W 


II 


fH 


U 


u 






q 


O 


o 


G 


<>H 


2 






O 







5 



er|c 



